Method and program for improving three-dimensional air excursion using a server and a client

ABSTRACT

In a server, a client for improving a three-dimensional air excursion and a method and programs thereof, a three-dimensional data can be automatically produced from aerial pictures or satellite images, and the three-dimensional air excursion on a three-dimensional solid map can be provided to a lot of users via the Internet. In the automatic producing of the three-dimensional image, a device for improving the produced images having defects is provided via the Internet. A particular user such as an owner or a manager of a particular structure such as a building, a monument in a park or the like can correct the images of the structure using a correction application via the Internet to obtain the more accurate images.

CROSS-REFERENCE TO RELATED PATENT APPLICATIONS

This application is a division of application Ser. No. 10/012,509, filedDec. 12, 2001, now pending, and related to a concurrently filedapplication entitled Client and Program for Improving Three-DimensionalAir Excursion and Method Thereof (Attorney Docket No. 072982-0270) andbased on Japanese Patent Application No. 2000-38014, filed Dec. 14,2000, by Hideo Shimazu. This application claims only subject matterdisclosed in the parent application and therefore presents no newmatter.

BACKGROUND OF THE INVENTION

The present invention relates to a server, a client for improving athree-dimensional air excursion and a method and programs thereof, andmore particularly to a server, a client for improving athree-dimensional air excursion and a method and programs thereof forproviding a device for improving produced images having defects by usingthe Internet when automatically producing a three-dimensional solid mapin a three-dimensional air excursion service provided on the Internet.

DESCRIPTION OF THE RELATED ART

In a conventional searching method of a home page on the World Wide Webor a page on the i-mode network, in general, a previously distributedmenu of the Yahoo or the like is traced and a link is followed to findthe target page. In another conventional searching method, a keyword isgiven to a search engine of the AltaVista or the like to obtain hitpages in a search.

One feature of these searching methods permits the searching of thepages entirely independent of their physical positions. For example,when information concerning flower shops is searched, hit pages of theflower shops in Tokyo, Paris, Sapporo and so on are obtained regardlessof their actual locations.

This feature is useful when a user does not intend to designate a place.However, there is a case where the user wants to find proper flowershops. For example, even when the user want to obtain only the pages ofthe flower shops near a certain place, the conventional searching methodpicks up the pages of the flower shops in Paris, Sapporo and so on.

For solving this inconvenience, there is a service in whichtwo-dimensional map information is given to the user, and when the userpoints to one place on the map, a link to shop information in that areais automatically followed to provide the shop information.

In such service, for example, a map of a country is shown and pointingone prefecture in the country on the map enables a user to access a Website showing the information of the prefecture. For instance, a Frenchmap is shown in the home page of the French governmental travel bureau(http://www.franceinformation.or.jp/oindex/index.html), and clicking amouse on one prefecture on the French map calls up related informationof that prefecture.

This is the service that can be realized on the Web by using a clickablemap technique and is used very often. In the following, Japanese PatentNo. 2,756,483 entitled “Advertisement information providing method andits registering method” (prior art 1), in which information of linktargets is limited to advertisement information, and onlytwo-dimensional maps are used, will be explained as an example of theservice.

In prior art 1, advertisement information is linked to its relatedposition in previously stored map information, and when the userdesignates one position on the map, the advertisement information at thedesignated position is provided.

In such method as represented by prior art 1, that the two-dimensionalmap information is provided and the user inputs the positionalinformation on the map, following problems arise.

First, update of map information requires very much time, labor andcost. In particular, rebuilding of structures and construction of newroads are frequently carried out in cities, and in order to reflectthese changes to the map rapidly, the maintenance and the update of themap requires enormous works.

Second, the information search from the map is short ofentertainingness. The search on the map is just like an operation forfinding some station along a railroad line. To enhance users' enjoyment,it is thinkable that the maps provided to the users are made to be moreentertaining, for example, by employing three-dimensional solid maps.

As a producing method of the three-dimensional solid map, a method ofproducing the map from plural pictures has been developed. As to thepictures to be used, for example, an aerial photograph taken from thesky and a satellite image taken from an artificial satellite aredesirable.

However, the three-dimensional image data production using the aerialpicture and the satellite image involves a fatal problem. That is, allexistent objects on the ground surface cannot be always taken in theaerial photograph.

For instance, when a rectangular solid building is taken from twodifferent points, apart from its top surface, each picture surelyrecords different two of four sides and if there are overlapping partsin the remaining two sides, a three-dimensional image of the rectangularsolid building can be produced by the plural pictures taken from thedifferent points. However, it is likely that the plural pictures showthe three sides of the building but none of them shows the remaining oneside, since generally the buildings are not regularly arranged in thesame direction but face to various directions on the ground surface. Asa result, no information about color, shape and texture of the remainingone side can be obtained. With the lack of such information, thethree-dimensional image of the building cannot be produced.

Hence, to produce a three-dimensional image in such a case, a programfor assigning the default color, shape and texture appropriately to theunseen one side is required in order to complement the lack of theinformation. For example, regarding the color and the texture, the sameas or the average value of the other three sides can be used, andconcerning the shape, it is supposed that the unseen one side is a usualflat surface. However, the produced building image may not have the trueform. Only the unseen one side may have a special shape or a differentcolor. Thus, when the owner or the manager of the building sees theproduced image, it is highly likely that he wants to revise the image.

In the case that a three-dimensional image is automatically produced byusing aerial photographs or satellite images of a certain area, withconsideration in principle, a three-dimensional image of the wholeTokyo, the whole Japan or the whole world can be produced and serviceutilizing the three-dimensional image can be provided. In the service,there are theoretically only problems of a machine power and a cost ofpicture photographing except for a problem of a scale. However, it isimpossible for a service provider using the three-dimensional image tocheck whether or not the shapes of buildings are correct one by one.

SUMMARY OF THE INVENTION

It is therefore an object of the present invention to provide a server,a client for improving a three-dimensional air excursion and a methodand programs thereof for providing a device for improving producedimages having defects by using the Internet when automatically producinga three-dimensional solid map in a three-dimensional air excursionservice provided on the Internet in view of the aforementioned problemsof the prior art.

That is, as shown in FIG. 1, the present invention provides a functionwhich permits an ordinary user to carry out an excursion flight in athree-dimensional space, and in addition, a function which allows a userhaving a special right such as an owner or a manager of athree-dimensional shape object such as a building and a monument in apark present in a three-dimensional space to change its image throughthe Internet.

In accordance with one aspect of the present invention, there isprovided a server for improving a three-dimensional air excursion,comprising: a three-dimensional image database for storing athree-dimensional image data including a three-dimensional objectidentification for uniquely identifying a three-dimensional object dataproduced by a stereographic processing of photograph data with acorrespondence of the three-dimensional image data and a ground surfaceposition; a structure database for storing a structure identificationfor uniquely identifying a structure, a physical position of thestructure on a ground surface and a three-dimensional objectidentification corresponding to the structure, in corresponding state;and a structure identification finding means for calculating thephysical position of the structure corresponding to thethree-dimensional object identification included in thethree-dimensional image data from the ground surface positioncorresponding to the three-dimensional image data, specifying thestructure identification in the structure database on the basis of thecalculated physical position of the structure and the physical positionof the structure in the structure database, and storing thethree-dimensional object identification corresponding to the structurewith a correspondence of the specified structure identification and thethree-dimensional object identification in the structure database.

In the present invention, the server may further comprise a positioninput type three-dimensional image output means for reading thethree-dimensional image data out of the three-dimensional image databaseon the basis of its input position to output the readoutthree-dimensional image data.

The server of the present invention may further comprise a structurechanging means for producing a three-dimensional object data of thestructure after changing the structure on the basis of a change contentof the structure for updating the structure included in athree-dimensional solid map.

In accordance with another aspect of the present invention, there isprovided a server for improving a three-dimensional air excursion,comprising: a three-dimensional image database for storing athree-dimensional image data including a set of three-dimensional objectidentifications for uniquely identifying three-dimensional object dataproduced by a stereographic processing of photograph data with acorrespondence of the three-dimensional image data and a ground surfaceposition; a structure database for storing a structure identificationfor uniquely identifying a structure and a three-dimensional objectidentification corresponding to the structure; and a structure changingmeans for producing a three-dimensional object data of the structureafter changing the structure on the basis of a change content of thestructure for updating the structure included in a three-dimensionalsolid map.

In a server of the present invention, the structure database may includea change yes no column for showing whether or not the three-dimensionalobject data is produced after the change, and the structure changingmeans indicates a change yes in the change yes no column of thestructure database when producing the three-dimensional object dataafter the change. The server may further comprise an object database forstoring the three-dimensional object data and the three-dimensionalobject identifications; a change object database for storing thethree-dimensional object data produced by the structure changing meansafter the change and the structure identifications; and a position inputtype three-dimensional image output means for reading thethree-dimensional image data out of the three-dimensional image databaseon the basis of the input position, looking up the change yes no columnof the structure database by using the three-dimensional objectidentification included in the readout three-dimensional image data,extracting the three-dimensional object data after the change from thechange object database by using the coincident structure identificationwhen the change yes is indicated in the change yes no column of thestructure database, and extracting the three-dimensional object datafrom the object database by using the three-dimensional objectidentification when a change no is indicated in the change yes nocolumn.

In a server of the present invention, the structure database stores aphysical position of the structure on the ground surface, and thethree-dimensional image database stores the three-dimensional image dataincluding a set of three-dimensional object identifications for uniquelyidentifying the three-dimensional object data produced by thestereographic processing of the photograph data with a correspondence ofthe three-dimensional image data and the ground surface position. Theserver may further comprise a structure identification finding means forcalculating the physical position of the structure corresponding to thethree-dimensional object identification included in thethree-dimensional image data from the ground surface positioncorresponding to the three-dimensional image data, specifying thestructure identification in the structure database on the basis of thecalculated physical position of the structure and the physical positionof the structure in the structure database, and storing thethree-dimensional object identification corresponding to the structurewith a correspondence of the specified structure identification and thethree-dimensional object identification in the structure database.

In the server of the present invention, the change content of thestructure may include image data showing at least one side to be changedfor an objective structure, a photographed position and a cameraposition, and the structure changing means may specify the photographdata including the structure on the basis of the input structureidentification and newly produces the three-dimensional object dataafter the change on the basis of the specified photograph data and theinput image data.

In the server of the present invention, the change content of thestructure may include image data showing all sides for an objectivestructure, a photographed position and a camera position, and thestructure changing means may newly produce the three-dimensional objectdata after the change on the basis of the input image data.

In the server of the present invention, the structure changing means mayread the three-dimensional object data of the structure to be changedout of the object database on the basis of the input structureidentification to present the readout three-dimensional object data to auser and produces the three-dimensional object data after the change onthe basis of the input change content of the structure.

In the server of the present invention, the three-dimensional objectdata and the three-dimensional object data after the change includeshape information representing a size and a shape of the structure andtexture information representing a texture mapped to each side of thestructure, and the change content of the structure is about the shapeinformation and the texture information.

The server of the present invention may further comprise a standarddatabase for storing a ground area standard of the structure on thethree-dimensional solid map, correspondingly to the structureidentification, wherein the structure changing means discriminateswhether or not the three-dimensional object data produced after thechange meets the ground area standard and stores the three-dimensionalobject data after the change in the change object database when thethree-dimensional object data after the change meets the ground areastandard.

In the server of the present invention, the ground area standard is theground surface area on the three-dimensional solid map storing thestructure, and the structure changing means may determine whether or notthe three-dimensional object data after the change meets the ground areastandard by discriminating whether or not the three-dimensional objectdata after the change is within a certain area of the ground surfacearea.

In the server of the present invention, the ground area standard is theground surface area on the three-dimensional solid map storing thestructure, and the structure changing means may determine whether or notthe three-dimensional object data after the change meets the ground areastandard by discriminating whether or not the three-dimensional objectdata after the change is within a certain area of a solid area producedby moving the ground surface area in a direction perpendicular to theground.

In the server of the present invention, the structure database may storean owner name of the structure corresponding to the structureidentification, corresponding to the structure identification. Theserver may further comprise an authentication processing means forrequiring the owner name of the structure to be changed and thestructure identification from the user when the change content of thestructure is sent from the user, and executing a user authentication byusing the received structure identification and the owner name of thestructure.

The server of the present invention may further comprise anauthentication database for storing a password registered by the user,corresponding to each structure identification; and an authenticationprocessing means for requiring at least the structure identification andthe password from the user when the change content of the structure issent from the user, specifying the corresponding password in theauthentication database by using the received structure identificationand executing a user authentication by using the specified password.

The server of the present invention may further comprise athree-dimensional image converting means for executing the stereographicprocessing of the photograph data and producing the three-dimensionalimage data including the three-dimensional object identification foruniquely identifying the produced three-dimensional object data.

In the server of the present invention, the photograph data is either anaerial photograph or a satellite image taken from an upper air.

In accordance with another aspect of the present invention, there isprovided a client for improving a three-dimensional air excursion,comprising: a position information output means for outputting positioninformation to a server for improving a three-dimensional air excursion,which stores three-dimensional image data including a three-dimensionalobject identification for uniquely identifying three-dimensional objectdata produced by a stereographic processing of photograph data with acorrespondence of the three-dimensional image data and a ground surfaceposition in a three-dimensional image database, stores a structureidentification for uniquely identifying a structure, a physical positionof the structure on a ground surface and a three-dimensional objectidentification corresponding to the structure, in corresponding state,in a structure database, calculates the physical position of thestructure corresponding to the three-dimensional object identificationincluded in the three-dimensional image data from the ground surfaceposition corresponding to the three-dimensional image data, specifiesthe structure identification in the structure database on the basis ofthe calculated physical position of the structure and the physicalposition of the structure in the structure database, and stores thethree-dimensional object identification corresponding to the structurewith a correspondence of the specified structure identification and thethree-dimensional object identification in the structure database; and athree-dimensional browser for having the server output thethree-dimensional image data read out of the three-dimensional imagedatabase on the basis of the position information and producing athree-dimensional image solid expression from viewpoint positioninformation on the basis of the output three-dimensional image data.

In accordance with another aspect of the present invention, there isprovided a client for improving a three-dimensional air excursion,comprising: a change content output means for outputting a changecontent received from a user for updating a structure included in athree-dimensional solid map to a server for improving athree-dimensional air excursion, which executes a stereographicprocessing of a plurality of photograph data including photographs ofthe same area shot from different angle points, ground surface positionsof photographed areas and camera positions to produce three-dimensionalobject data, stores three-dimensional image data including athree-dimensional object identification for uniquely identifying theproduced three-dimensional object data with a correspondence of thethree-dimensional image data and the ground surface position in athree-dimensional image database, and stores a structure identificationfor uniquely identifying a structure and the three-dimensional objectidentification corresponding to the structure in a structure database;and a device to make the server produce three-dimensional object data ofthe structure after its change on the basis of the change content of thestructure.

In accordance with another aspect of the present invention, there isprovided a client for improving a three-dimensional air excursion,comprising: a change content output means for outputting a structureidentification for updating a structure included in a three-dimensionalsolid map to a server for improving a three-dimensional air excursion,which executes a stereographic processing of a plurality of photographdata including photographs of the same area shot from different anglepoints, ground surface positions of photographed areas and camerapositions to produce three-dimensional object data, storesthree-dimensional image data including a three-dimensional objectidentification for uniquely identifying the produced three-dimensionalobject data with a correspondence of the three-dimensional image dataand the ground surface position in a three-dimensional image database,and stores a structure identification for uniquely identifying astructure and the three-dimensional object identification correspondingto the structure in a structure database, having the server read thethree-dimensional object data of the structure to be updated out of anobject database on the basis of the input structure identification andoutput the readout three-dimensional object data to the client,presenting the input three-dimensional object data, and outputting achange content of the structure to the server; and a device to make theserver produce three-dimensional object data of the structure after itschange on the basis of the change content of the structure.

In the client of the present invention, the structure database mayinclude a change yes no column for showing whether or not thethree-dimensional object data after the change is produced by theserver. The client may further comprise a position information outputmeans for outputting position information input by a user to the serverwhich indicates a change yes in the change yes no column of thestructure database when producing the three-dimensional object dataafter the change, stores the three-dimensional object data and thethree-dimensional object identification in the object database, andstores the three-dimensional object data after the change and thestructure identification in a change object database; and athree-dimensional browser for having the server read thethree-dimensional image data out of the three-dimensional image databaseon the basis of the input position information, look up the change yesno column of the structure database by using the three-dimensionalobject identification included in the readout three-dimensional imagedata, extract the three-dimensional object data after the change fromthe change object database by using the coincident structureidentification when the change yes is shown in the change yes no column,extract the three-dimensional object data from the object database byusing the three-dimensional object identification when the change no isshown in the change yes no column and output the extractedthree-dimensional object data included in the three-dimensional imagedata, and thereby producing a three-dimensional image solid expressionfrom the viewpoint position information input by the user on the basisof the received three-dimensional image data.

In accordance with another aspect of the present invention, there isprovided a method for improving a three-dimensional air excursion usinga server for improving a three-dimensional air excursion and a clientfor improving a three-dimensional air excursion, comprising the stepsof: storing three-dimensional image data including a three-dimensionalobject identification for uniquely identifying three-dimensional objectdata produced by a stereographic processing of photograph data with acorrespondence of the three-dimensional image data and a ground surfaceposition in a three-dimensional image database in the server; storing astructure identification for uniquely identifying a structure, aphysical position of the structure on a ground surface and athree-dimensional object identification corresponding to the structure,in corresponding state, in a structure database in the server;calculating the physical position of the structure corresponding to thethree-dimensional object identification included in thethree-dimensional image data, specifying the structure identification inthe structure database on the basis of the calculated physical positionand the physical position of the structure in the structure database,and storing the three-dimensional object identification corresponding tothe structure, correspondingly to the specified structure identificationin the structure database in the server by a structure identificationfinding means; outputting position information to the server by aposition information output means in the client; reading thethree-dimensional image data out of the three-dimensional image databaseon the basis of the position information sent from the client andoutputting the readout three-dimensional image data by a position inputtype three-dimensional image output means in the server; and producing athree-dimensional image solid expression from input viewpoint positioninformation on the basis of the three-dimensional image data sent fromthe position input type three-dimensional image output means by theclient.

In accordance with another aspect of the present invention, there isprovided a method for improving a three-dimensional air excursion usinga server for improving a three-dimensional air excursion and a clientfor improving a three-dimensional air excursion, comprising the stepsof: outputting a change content sent from a user for updating astructure included in a three-dimensional solid map to the server by achange content output means in the client; and producingthree-dimensional object data of the structure after the change on thebasis of the change content of the structure sent from the client by astructure changing means in the server.

In accordance with another aspect of the present invention, there isprovided a method for improving a three-dimensional air excursion usinga server for improving a three-dimensional air excursion and a clientfor improving a three-dimensional air excursion, comprising the stepsof: executing a stereographic processing of a plurality of photographdata including photographs of the same area shot from different anglepoints, ground surface positions of photographed areas and camerapositions to produce three-dimensional object data, and storingthree-dimensional image data including a three-dimensional objectidentification for uniquely identifying the produced three-dimensionalobject data with; storing a structure identification for uniquelyidentifying a structure and the three-dimensional object identificationcorresponding to the structure in a structure database in the server;outputting a change content received from a user for updating thestructure included in a three-dimensional solid map to the server by achange content output means in the client; and producing thethree-dimensional object data of the structure after the change on thebasis of the input change content of the structure by a structurechanging means in the server.

In accordance with another aspect of the present invention, there isprovided a method for improving a three-dimensional air excursion usinga server for improving a three-dimensional air excursion and a clientfor improving a three-dimensional air excursion, comprising the stepsof: executing a stereographic processing of a plurality of photographdata including photographs of the same area shot from different anglepoints, ground surface positions of photographed areas and camerapositions to produce three-dimensional object data, and storingthree-dimensional image data including a three-dimensional objectidentification for uniquely identifying the produced three-dimensionalobject data with a correspondence of the three-dimensional image dataand the ground surface position in a three-dimensional image database inthe server; storing a structure identification for uniquely identifyinga structure and the three-dimensional object identificationcorresponding to the structure in a structure database in the server;outputting a structure identification for updating a structure includedin a three-dimensional solid map to the server by a change contentoutput means in the client; reading the three-dimensional object data ofthe structure to be updated out of an object database on the basis ofthe input structure identification to output the readoutthree-dimensional object data to the client by a structure changingmeans in the server; presenting the input three-dimensional object andoutputting a change content of the structure to the server by the changecontent output means in the client; and producing the three-dimensionalobject data of the structure after the change on the basis of the inputchange content of the structure by the structure changing means in theserver.

In accordance with another aspect of the present invention, there isprovided a method for improving a three-dimensional air excursion usinga server for improving a three-dimensional air excursion and a clientfor improving a three-dimensional air excursion, comprising the stepsof: executing a stereographic processing of a plurality of photographdata including photographs of the same area shot from different anglepoints, ground surface positions of photographed areas and camerapositions to produce three-dimensional object data, and storingthree-dimensional image data including a three-dimensional objectidentification for uniquely identifying the produced three-dimensionalobject data with a correspondence of the three-dimensional image dataand the ground surface position in a three-dimensional image database inthe server; storing a structure identification for uniquely identifyinga structure, the three-dimensional object identification correspondingto the structure and an owner name of the structure in a structuredatabase in the server; outputting a change content of the structure,sent from a user, for updating the structure included in athree-dimensional solid map, the structure identification of thestructure and the owner name of the structure to the server by a changecontent output means in the client; executing a user authentication byusing the input structure identification and the owner name of thestructure by an authentication processing means in the server; andproducing the three-dimensional object data of the structure after thechange on the basis of the input change content of the structure by astructure changing means in the server.

In accordance with another aspect of the present invention, there isprovided a method for improving a three-dimensional air excursion usinga server for improving a three-dimensional air excursion and a clientfor improving a three-dimensional air excursion, comprising the stepsof: executing a stereographic processing of a plurality of photographdata including photographs of the same area shot from different anglepoints, ground surface positions of photographed areas and camerapositions to produce three-dimensional object data, and storingthree-dimensional image data including a three-dimensional objectidentification for uniquely identifying the produced three-dimensionalobject data; storing a structure identification for uniquely identifyinga structure and the three-dimensional object identificationcorresponding to the structure in a structure database in the server;storing a password registered by a user corresponding to each structureidentification in an authentication database in the server; outputting achange content of the structure, sent from the user, for updating thestructure included in a three-dimensional solid map, at least thestructure identification and the password to the server by a changecontent output means in the client; specifying the correspondingpassword in the authentication database by using the input structureidentification and executing a user authentication by using thespecified password by an authentication processing means in the server;and producing the three-dimensional object data of the structure afterthe change on the basis of the input change content of the structure bya structure changing means in the server.

In the method of the present invention, the structure database mayinclude a change yes no column for showing whether or not thethree-dimensional object data after the change is produced by thestructure changing means, and the structure changing means indicates achange yes in the change yes no column of the structure database whenproducing the three-dimensional object data after the change. The methodmay further comprise the steps of: storing the three-dimensional objectdata and the three-dimensional object identification in an objectdatabase in the server; storing the three-dimensional object data afterthe change and the structure identification in a change object databasein the server; outputting the position information input by the user tothe server by a position information output means in the client; readingthe three-dimensional image data out of the three-dimensional imagedatabase on the basis of the input position information, looking up thechange yes no column of the structure database by using thethree-dimensional object identification included in the readoutthree-dimensional image data, extracting the three-dimensional objectdata after the change from the change object database by using thecoincident structure identification when the change yes is shown in thechange yes no column, extracting the three-dimensional object data fromthe object database by using the three-dimensional object identificationwhen the change no is shown in the change yes no column, and outputtingthe extracted three-dimensional object data included in thethree-dimensional image data by a position input type three-dimensionalimage output means in the server; and producing a three-dimensionalimage solid expression from the viewpoint position information input bythe user on the basis of the three-dimensional image data sent from theposition input type three-dimensional image output means by athree-dimensional browser in the client.

The method of the present invention may further comprise the steps of:storing the physical position of the structure on the ground surface inthe structure database; and calculating the physical position of thestructure corresponding to the three-dimensional object identificationincluded in the three-dimensional image data on the basis of the groundsurface position corresponding to the three-dimensional image data,specifying the structure identification of the structure database on thebasis of the calculated physical position and the physical position ofthe structure in the structure database, and storing thethree-dimensional object identification corresponding to the structure,correspondingly to the specified structure identification in the serverby a structure identification finding means.

In the method of the present invention, the change content of thestructure may include image data showing at least one side to bechanged, a ground surface position of a photographed area and a cameraposition. The method may further comprise the steps of: outputting thestructure identification of the structure to be updated to the server bythe change content output means in the client; and specifying thephotograph data including the structure on the basis of the structureidentification input by the client and newly producing thethree-dimensional object data after the change on the basis of thespecified photograph data and the input image data by the structurechanging means in the server.

In the method of the present invention, the change content of thestructure to be changed may include image data showing all sides, aground surface position of a photographed area and a camera position.The method may further comprise the step of newly producing thethree-dimensional object data after the change on the basis of the inputimage data by the structure changing means.

In the method of the present invention, the three-dimensional objectdata and the three-dimensional object data after the change may includeshape information representing a size and a shape of the structure andtexture information representing a texture mapped to each side of thestructure, and the change content of the structure includes the shapeinformation and the texture information.

In the present invention, the method may further comprise the steps of:storing a ground area standard of the structure on the three-dimensionalsolid map, corresponding to the three-dimensional object identificationin a standard database, discriminating whether or not thethree-dimensional object data produced after the change meets the groundarea standard; and storing the three-dimensional object data after thechange in the change object database when the three-dimensional objectdata after the change meets the ground area standard by the structurechanging means.

In the method of the present invention, the ground area standard is theground surface area of the three-dimensional solid map storing thestructure. The method may further comprise the step of determiningwhether or not the three-dimensional object data after the change meetsthe ground area standard by discriminating whether or not thethree-dimensional object data after the change is within a certain areaof the ground surface area by the structure changing means.

In the method of the present invention, the ground area standard is theground surface area of the three-dimensional solid map storing thestructure. The method may further comprise the step of determiningwhether or not the three-dimensional object data after the change meetsthe ground area standard by discriminating whether or not thethree-dimensional object data after the change is within a certain areaof a solid area produced by moving the ground surface area in adirection perpendicular to the ground by the structure changing means.

In the present invention, the method may further comprise the step ofexecuting the stereographic processing of the photograph data, andproducing the three-dimensional image data including thethree-dimensional object identification for uniquely identifying theproduced three-dimensional object data by a three-dimensional imageconverting means in the server.

In the method of the present invention, the photograph data is either anaerial photograph or a satellite image taken from an upper air.

In accordance with another aspect of the present invention, there isprovided a computer program for a server for improving athree-dimensional air excursion to execute processes of: storingthree-dimensional image data including a three-dimensional objectidentification for uniquely identifying a three-dimensional object dataproduced by a stereographic processing of photograph data with acorrespondence of the three-dimensional image data and a ground surfaceposition in a three-dimensional image database; storing a structureidentification for uniquely identifying a structure, a physical positionof the structure on a ground surface and a three-dimensional objectidentification corresponding to the structure, in corresponding state,in a structure database; and calculating the physical position of thestructure corresponding to the three-dimensional object identificationincluded in the three-dimensional image data from the ground surfaceposition corresponding to the three-dimensional image data, specifyingthe structure identification in the structure database on the basis ofthe calculated physical position of the structure and the physicalposition of the structure in the structure database, and storing thethree-dimensional object identification corresponding to the structurewith a correspondence of the specified structure identification and thethree-dimensional object identification in the structure database by astructure identification finding means.

In accordance with another aspect of the present invention, there isprovided a computer program for a server for improving athree-dimensional air excursion to execute processes of: storing athree-dimensional image data including a set of three-dimensional objectidentifications for uniquely identifying three-dimensional object dataproduced by a stereographic processing of photograph data with acorrespondence of the three-dimensional image data and a ground surfaceposition in a three-dimensional image database; storing a structureidentification for uniquely identifying a structure and athree-dimensional object identification corresponding to the structurein a structure database; and producing a three-dimensional object dataof the structure after changing the structure on the basis of a changecontent of the structure for updating the structure included in athree-dimensional solid map by a structure changing means.

The recording medium of the present invention may store a computerprogram for a server for improving a three-dimensional air excursion toexecute processes of: preparing a change yes no column for showingwhether or not the three-dimensional object data is produced after thechange in the structure database, indicating change yes in the changeyes no column of the structure database when producing thethree-dimensional object data after the change by the structure changingmeans; storing the three-dimensional object data and thethree-dimensional object identifications in an object database; storingthe three-dimensional object data produced by the structure changingmeans after the change and the structure identifications in a changeobject database; and reading the three-dimensional image data out of thethree-dimensional image database on the basis of the input position,looking up the change yes no column in the structure database by usingthe three-dimensional object identification included in the readoutthree-dimensional image data, extracting the three-dimensional objectdata after the change from the change object database by using thecoincident structure identification when the change yes is indicated inthe change yes no column of the structure database, and extracting thethree-dimensional object data from the object database by using thethree-dimensional object identification when a change no is indicated inthe change yes no column by a position input type three-dimensionalimage output means.

In accordance with another aspect of the present invention, there isprovided a computer program for a client for improving athree-dimensional air excursion to execute processes of: outputtingposition information to a server storing three-dimensional image dataincluding a three-dimensional object identification for uniquelyidentifying three-dimensional object data produced by a stereographicprocessing of photograph data with a correspondence of thethree-dimensional image data and a ground surface position in athree-dimensional image database, storing a structure identification foruniquely identifying a structure, a physical position of the structureon a ground surface and a three-dimensional object identificationcorresponding to the structure, in corresponding state, in a structuredatabase, calculating the physical position of the structurecorresponding to the three-dimensional object identification included inthe three-dimensional image data from the ground surface positioncorresponding to the three-dimensional image data, specifying thestructure identification in the structure database on the basis of thecalculated physical position of the structure and the physical positionof the structure in the structure database, and storing thethree-dimensional object identification corresponding to the structurewith a correspondence of the specified structure identification and thethree-dimensional object identification in the structure database, by aposition information output means; and having the server output thethree-dimensional image data read out of the three-dimensional imagedatabase on the basis of the position information, and producing athree-dimensional image solid expression from viewpoint positioninformation on the basis of the output three-dimensional image data by athree-dimensional browser.

In accordance with another aspect of the present invention, there isprovided a computer program for a client for improving athree-dimensional air excursion to execute processes of: outputtingposition information input by a user to a server preparing a change yesno column for showing whether or not the three-dimensional object dataafter the change is produced by the server in the structure database;storing a change yes in the change yes no column of the structuredatabase when producing the three-dimensional object data after thechange, storing the three-dimensional object data and thethree-dimensional object identification in the object database, andstoring the three-dimensional object data after the change and thestructure identification in a change object database, by a positioninformation output means; and having the server read thethree-dimensional image data out of the three-dimensional image databaseon the basis of the input position information, extract thethree-dimensional object data from the object database by using thethree-dimensional object identification included in the readoutthree-dimensional image data, and output the extracted three-dimensionalobject data included in the three-dimensional image data, and producinga three-dimensional image solid expression from the viewpoint positioninformation input by the user on the basis of the receivedthree-dimensional image data by a three-dimensional browser.

BRIEF DESCRIPTION OF THE DRAWINGS

The objects, features and advantages of the present invention willbecome more apparent from the consideration of the following detaileddescription, taken in conjunction with the accompanying drawings, inwhich:

FIG. 1 is a schematic block diagram of a system for realizing athree-dimensional air excursion service for an ordinary user and astructure image correction service for a particular user on athree-dimensional solid map according to the present invention;

FIG. 2 is a schematic perspective view for explaining an operation of apolygonization of a structure in the system shown in FIG. 1;

FIG. 3 is a schematic view showing a flow of a three-dimensional imagedata producing performed in the system shown in FIG. 1;

FIG. 4 is a schematic view for showing a three-dimensional air excursionservice provided by the system shown in FIG. 1;

FIG. 5 is a block diagram of a system for providing a three-dimensionalair excursion service for an ordinary user and a structure imagecorrection service for a particular user on a three-dimensional solidmap according to a first embodiment of the present invention;

FIG. 6 is a flowchart for showing an operation of a structure ID findershown in FIG. 5;

FIG. 7 is a flowchart for showing an operation of a structure changershown in FIG. 5;

FIG. 8 is a flowchart for showing an operation of a three-dimensionalbrowser shown in FIG. 5;

FIG. 9 is a graph showing relationship among a three-dimensional imagedatabase, a structure database and an object database, partly shown inFIG. 5;

FIG. 10 is a graph showing relationship among a three-dimensional imagedatabase, a structure database and an change object database, partlyshown in FIG. 5;

FIG. 11 is a schematic block diagram of a system for updating astructure with a user authentication device according to the firstembodiment of the present invention;

FIG. 12 is a graph showing relationship between a structure database andan authentication database shown in FIG. 11;

FIG. 13 is a flowchart for showing a user authentication operationperformed by the system shown in FIG. 11;

FIG. 14 is a graph showing relationship between a structure database anda standard database shown in FIG. 11;

FIG. 15 is a flowchart for showing a change content input operationperformed by the system shown in FIG. 11;

FIG. 16 is a graph showing relationship between a three-dimensionalimage database and an image ID database shown in FIG. 11;

FIG. 17 is a flowchart for showing an operation of step S111 shown inFIG. 15;

FIG. 18 is a schematic view of a change content input home pageaccording to the first embodiment of the present invention; and

FIG. 19 is a block diagram of a system for realizing a server and aclient according to the first embodiment of the present invention.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The preferred embodiments of the present invention will be describedmore specifically in connection with the attached figures.

The present invention provides a three-dimensional solid map for a lotof users via the Internet. For example, the present invention provides aconfiguration for faithfully reproducing actual scenery as athree-dimensional solid map by a three-dimensional air excursion machineand method for providing an air excursion function on thethree-dimensional solid map.

In the description of the present invention, as a three-dimensionalsolid map producing method, a method for producing a three-dimensionalsolid map using plural aerial pictures or satellite images is used.Besides, using the three-dimensional solid map produced in this manner,an air excursion function on a three-dimensional solid map is providedto users via the Internet.

There is shown in FIG. 1 a system for realizing a three-dimensional airexcursion service for an ordinary user and a structure image correctionservice for a particular user such as an owner or a manager of abuilding in order to correct or revise the structure image of thebuilding on a three-dimensional solid map according to the presentinvention.

As shown in FIG. 1, in the system of the present invention, there are anordinary user 110 and a particular user 120 such as an owner or amanager of a particular building or the like. The present inventionprovides an air excursion service on the three-dimensional solid map forthe ordinary user 110 and a structure image correction service of theparticular building on the three-dimensional solid map for theparticular user 120. In FIG. 1, a provider side of these services is athree-dimensional air excursion service provider 130. Thethree-dimensional air excursion service provider 130 has athree-dimensional image database 3 which stores a combination ofstructure identifying information (attribute: structure and definitionarea: building 1, building 2, building 3, . . . ) and an owner or amanager of each building (attribute: owner or manager and definitionarea: user 1, user 2, user 3, . . . ) as its data structure 131.

Further, the ordinary user 110 connects the three-dimensional airexcursion service provider 130 via the Internet 100 by using a serviceapplication 111 in order to receive the three-dimensional air excursionservice from the three-dimensional air excursion service provider 130,and the particular user 120 connects the three-dimensional air excursionservice provider 130 via the Internet 100 by using a correctionapplication 121 to receive the structure image correction service fromthe three-dimensional air excursion service provider 130.

Consequently, the ordinary user 110 enjoys the three-dimensional airexcursion service by the service application 111, and the particularuser 120 receives the service to correct the structure image of theparticular building that the particular user 120 owns or manages on thethree-dimensional solid map by the correction application 121.

[Production of Three-Dimensional Solid Map]

First, as the three-dimensional solid map producing method, a method forproducing a three-dimensional solid map by carrying out a stereographicprocessing of two pictures obtained by photographing the ground is used.However, according to the present invention, any method having thecapability of producing the three-dimensional solid map applicable tothe present invention can be used. As to the plural pictures, an aerialphotograph taken from the sky and a satellite image taken from anartificial satellite are used.

Regarding the aerial photograph and the satellite image to be used inthe present invention, for example, a commercially available satelliteimage taken from the artificial satellite IKONOS operated by SpaceImaging Corporation in the U.S. is employed. Further, this artificialsatellite IKONOS periodically moves round all over the earth, and thesatellite image of the whole ground of the earth can be boughtperiodically (e.g. approximately every one week). In order to make clearthe photographed ground surface area, the information on the accuratelatitude and longitude, and further photographed time are attached tothe aerial photographs and the satellite images. Hence, a purchaser canexactly know photographed area, shooting time and angle of everyphotograph. This is because the artificial satellite moves in thepredetermined orbit at the predetermined time. In this manner, theaerial photograph or the satellite image indicates the angle to theground surface, the distance from the ground surface and thephotographed area clearly, and thus can be suitably used for producingthe three-dimensional solid map.

Further, plural aerial photographs or satellite images obtained bytaking the same area from different angle points are stereographicallyprocessed, and from the discrepancy between the objects taken in theplural aerial photographs or the satellite images, heights ofstructures, mountains and the like are calculated. However, in aconventional stereographic processing, it is impossible to drawinformation to identify the mountains and the structures. This isbecause the stereographic processing includes only the process forcalculating a height of each unit point. In the three-dimensional solidmap producing method of the present invention, an image area accordingto certain rule is dealt as one object.

In the stereographic processing of the plural aerial photographs orsatellite images obtained by taking the same area from the differentangle points, for example, when the aerial photographs are taken from anairplane flying at a low altitude, it is possible to calculate a heightof an object per approximately 25 cm×25 cm square unit on the groundsurface. On the other hand, in the stereographic processing of theplural satellite images taken from an artificial satellite, the heightcalculation per approximately 1 m×1 m square unit on the ground surfaceis the processing limit at present. This is a sufficient resolution forproducing the three-dimensional solid map according to the presentinvention. However, when the aerial photographs or satellite imageshaving higher resolution are available, the more detailed image can berealized. The satellite images are hereinafter referred to as “aerialphotographs” as well for brevity in the following description of thepresent invention.

Further, the processing for calculating the heights of the mountains,the buildings and the like on the ground surface from the plural aerialphotographs is called digital elevation modeling (DEM). Processes in theDEM will be described in detail with reference to FIG. 2.

When the DEM is conducted by using plural aerial photographs, producedimage information indicates a height per each unit area (resolution),that is, 1 m×1 m square unit in this description. This image informationis visually explained in FIG. 2. In FIG. 2, the producedthree-dimensional image is shown like a row of poles. In other words,each unit is one strap having a predetermined height. This imageinformation is called a DEM image.

Taking the case that the height information is calculated every 1 m×1 msquare unit as an example, for instance, as to a building having 20 m×20m length and width square and 30 m high, the height of the 20 m×20 marea where the building is located is calculated as 30 m, and the heightof its surrounding area (the height of the ground surface) is calculatedas, for example, 0 m.

Now, applying a rule that the same height points which continuouslyexist are regarded as one structure, when there are points of 30 m highin 20 m×20 m area, a 20 m×20 m building having a height of 30 m isassumed to exist. In this processing, those continuous points having thesame height are handled as a structure. In this way, the continuous sameheight data is assumed as the structure, and this is called apolygonization in the description. As described above, the polygon datadetermined as the building (structure) is stored in a databasecorrespondingly to the information of the shape, the color and thetexture of this building (shape information and texture information) andthe information of the location of the polygon (the latitude andlongitude on the earth).

The aforementioned process is a series of flows of the three-dimensionalimage production by the stereographic processing.

According to the present invention, the stereographic processingtechnique, the DEM technique and the polygonization technique are notrestricted to the specific methods, and if technique can producenecessary data for the present invention, any technique is applicable asfar as it is not departing from the spirit and the scope of the presentinvention.

Further, when the stereographic processing is performed, a structure ora mountain is extracted as polygon data of a polygon. In the presentinvention, the extracted structure or mountain is called a landmark.Furthermore, the polygon data of the extracted landmark is calledthree-dimensional object data. The three-dimensional object data of thepresent invention includes the shape information of each landmark (forexample, the length information of each side of the top and the foursides when a landmark is a building of a quadrilateral pole) and thetexture information of each surface (the image information including thecolor information and the texture information).

However, as described above, a precise position information on the basisof certain point is given to the plural aerial photographs to besubjected to the stereographic processing, and it is possible to permitthe extracted three-dimensional object data to correspond not only tothe shape information and the texture information but also to theprecise position information. The position information is defined by thedistances from the reference point to an x-axis and a y-axis on thethree-dimensional solid map.

There is shown in FIG. 3 a schematic flow of a process for producing thethree-dimensional solid map from the plural aerial photographs. In FIG.3, first a satellite image correction is performed for the plural aerialphotographs. This satellite image correction includes processes forcorrecting the distortion caused by taking the aerial photograph using asuper-telephoto lens from the artificial satellite, correcting the shiftof the reference point itself (distortion-reference point correction),and for interpreting a ground image damaged by the clouds owing tophotographing from high above the sky (cloud area interpretation). Afterthe satellite image correction of the plural aerial photographs isconducted, the stereographic processing is carried out by using theeffective images to obtain the DEM image. Eventually, the polygonizationof the DEM image is performed to produce the three-dimensional objectdata.

When the three-dimensional solid map is formed on the basis of thethree-dimensional object data produced in this way to be provided to theusers, a viewpoint position is given on the three-dimensional solid map.The three-dimensional solid expression is projected to a two-dimensionalplane on the basis of the given viewpoint position to produce atwo-dimensional image of the three-dimensional solid expression.Concerning a producing method of this two-dimensional image, aconventional rendering method or the like has been known, and thus thedetailed description thereof is omitted. However, this method can bemodified into various forms without departing from the spirit and scopeof the present invention.

Further, by changing the viewpoint position given in the above-describedprocessing, a three-dimensional solid map seen from a differentdirection can be reproduced. For a user viewing the three-dimensionalsolid map from his viewpoint position, by successively moving theviewpoint position, the two-dimensional image just as he conducting anexcursion flight in the air can be obtained as shown in FIG. 4.Incidentally, in FIG. 4, the arrows indicate the moving direction of theuser. The viewpoint position of the user moves in agreement with thismoving direction, and the two-dimensional image of the three-dimensionalsolid expression is produced.

However, in the above producing of the three-dimensional object data onthe basis of the aerial photographs, all existent objects on the groundsurface cannot be always taken in the aerial photograph shot from thesky.

For example, when one rectangular solid landmark is taken from twodifferent points in the sky, there is the case where the three sides ofthe landmark are recorded but the remaining one side cannot be taken innone of the plural photographs. Such case can be readily caused sincethe landmarks are not regularly arranged in the same direction but inthe various directions on the ground surface.

Hence, even in such case, a program for producing the three-dimensionalobject data according to the present invention can complement thelacking side and produce the three-dimensional object data of theobjective landmark by appropriately applying the default shape, colorand texture to the lacking side. For example, when complementing thecolor and the texture to the lacking side, the same as or the averagevalue of the other three sides, the images of which are completelytaken, can be used. When complementing the shape of the lacking side,the lacking side is supposed to have a usual rectangular flat surfaceand the complement is carried out.

However, the completed three-dimensional object data obtained by such aprocessing does not always present the true form and the true texture.The lacking side can have a special shape or a different color. In suchcase, it is thinkable that the owner or the manager of the landmarkwants a correction of the landmark.

In addition, when the two-dimensional image data of thethree-dimensional solid expression is automatically produced by usingthe aerial photographs or the satellite images, if taking no account ofthe problem of its scale, it is possible in principle to produce thethree-dimensional object data of the whole Tokyo, the whole Japan or thewhole world, and provide the service using the three-dimensional objectdata. However, a manual operation is required for confirming whether ornot the shape of each landmark is correct one by one, and a serviceprovider cannot conduct this operation in practice.

Hence, the present invention provides a server, a client for improving athree-dimensional air excursion and a method and programs thereof, whichis capable of entrusting an owner or a manager of a structure such as abuilding with revising work of the structure to reduce work of a serviceprovider and realizing a three-dimensional solid map that the owner orthe manager is satisfied.

A three-dimensional air excursion machine of the present inventionincluding functions for producing a three-dimensional solid map fromplural aerial photographs and for permitting a particular user such asan owner or a manager of a landmark on the three-dimensional solid mapto update the image of the landmark through the Internet will bedescribed in detail with reference to the figures.

First Embodiment

First, a three-dimensional air excursion machine according to a firstembodiment of the present invention will be described in detail withreference to FIG. 5.

In FIG. 5, a three-dimensional air excursion machine for providing anair excursion in a three-dimensional image for a lot of users via theInternet according to the present invention comprises a server and aclient on the side of the three-dimensional air excursion serviceprovider 130. The server includes a three-dimensional image converter 2,a three-dimensional image database 3, a structure database 4, astructure ID finder 5, a position input type three-dimensional imageoutput unit 6, a structure changer 7. The client includes athree-dimensional browser 8. In this embodiment, the system shown inFIG. 5 is a client-server type distributed processing system. However,the present invention is not restricted to this system and variousmodifications can be made without departing from the spirit and thescope of the present invention

There is shown in FIG. 19 a construction for realizing each of theserver and the client described above.

[Construction of Server]

As shown in FIG. 19, in this embodiment, the server comprises a dataprocessing device 201 composed of a CPU or the like, a storage device202 to be used for storing readout programs and data and performingwork, a recording medium 203 such as a hard disk having a relativelylarge recording capacity, an input device 204 for controlling data inputfrom external devices via lines and an output device 205 for controllingdata output to the external devices via the lines. In this construction,for example, concerning the server shown in FIG. 5, thethree-dimensional image converter 2, the structure ID finder 5, theposition input type three-dimensional image output unit 6 and thestructure changer 7 are executed and operated by the data processingdevice 201, and the programs for executing and operating these membersare stored in the recording medium 203. Hence, when each of thethree-dimensional image converter 2, the structure ID finder 5, theposition input type three-dimensional image output unit 6 and thestructure changer 7 is executed or operated, each of the programs isread out of the recording medium 203 and is executed. The storage device202 further functions as an operation area of the data processing device201 and temporarily stores the readout programs and the result of theprocessing in operation. The input device 204 and the output device 205each control the communication with the external device such as theclient, and control to input a request via or from the client and tooutput the specified data or the processing result. In this embodiment,the three-dimensional image database 3 and the structure database 4 canbe adapted to be stored in the recording medium 203 or in anotherexternal recording medium (including a file server) (not shown) via theinput device 204.

[Construction of Client]

The construction shown in FIG. 19 can be used as the client. That is,the client shown in FIG. 5 comprises a data processing device 201, astorage device 202, a recording medium 203, an input device 204 and anoutput device 205 in the same manner as the server described above. Inthis construction, the program for executing and operating thethree-dimensional browser 8 is stored in the recording medium 203.Hence, when the three-dimensional browser 8 is executed or operated, theprogram is read out of the recording medium 203 by the data processingdevice 201 and the work area is reserved in the storage device 202. Theinput device 204 and the output device 205 control the communicationwith the Internet or the server connected to the client.

[Three-Dimensional Image Converter 2]

In FIG. 5, when plural aerial photographs 1 which are obtained by takingthe same area from different angle points and are specified by aphysical position such as latitude and longitude are input, thethree-dimensional image converter 2 carries out a stereographicprocessing of the plural aerial photographs 1 to produce athree-dimensional object ID (identification) set type ofthree-dimensional image data having shape information and textureinformation representing information of a shape, a color and a textureof an object and a physical position indicating an correct position ofthe object. The three-dimensional object ID includes the identificationinformation for uniquely identifying a corresponding object, andcorresponds to the information of the physical position of the object,such as the latitude and the longitude (which can be expressed by thedistances from a reference point or origin to an x-axis and a y-axis inthe three-dimensional image data), and to the shape information and thetexture information concerning the shape, the color and the texture ofthe object.

Regarding a method for discriminating the landmark in the data producedfrom the plural aerial photographs 1 in the above-described processing,when the DEM processing of the plural aerial photographs 1 is performed,the ground surface (an altitude 0 m) is discriminated and a landmarkhaving a larger height than a predetermined threshold height from theground surface and having a larger width over its top than apredetermined threshold width is determined to a structure. Thisembodiment is not restricted to this method, any method capable ofrecognizing a structure as an object can be applicable without departingfrom the spirit and the scope of the present invention.

The shape information such as the size and shape of the top and sides ofthe object discriminated as described above and the texture informationsuch as the color and the texture of the object corresponds to thethree-dimensional object ID and is stored and held in a database. Thisdatabase is an object database 10 shown in FIG. 9. The object database10 can be stored in the recording medium 203 shown in FIG. 19 or in anexternal recording medium (not shown) via the input device 204. Theobject database 10 can be configured as a relational database or anormal file type database.

Further, the three-dimensional image converter 2 shown in FIG. 5produces a database, for example, an image ID database 14 shown in FIG.16, for ensuring the relationship between the aerial photographs and theimage IDs, as required in the following processing. The image IDdatabase 14 includes image IDs assigned to respective three-dimensionalimage data produced by the three-dimensional image converter 2 andaerial photograph IDs for identifying the plural aerial photographs 1 asthe base for producing the three-dimensional image data as attributes.The image ID database 14 and the three-dimensional image database 3 arerelated with each other by the image IDs as a main key, and the aerialphotographs 1 will be read out at need when the three-dimensional objectdata is changed as hereinafter described. In the following, theseprocesses will be described.

[Three-Dimensional Image Database 3]

When the three-dimensional image data is produced by thethree-dimensional image converter 2, the three-dimensional image data,the image ID for uniquely identifying the three-dimensional image dataand the position such as the latitude and the longitude of the referenceposition of the three-dimensional image data are stored in thethree-dimensional image database 3 as a unit record. Thethree-dimensional image database 3, like the aforementioned objectdatabase 10, can be configured as a relational database or a normal filetype database. As regards the designation of this position, when thethree-dimensional image data to be produced has a fixed size (in alllength, width and shape), it is enough to specify only the latitude andthe longitude of the reference point. However, when the size isdifferent in each three-dimensional image data, the data about the shapeis stored in the same record. For instance, when it is only determinedthat each three-dimensional image data represents a rectangular area andlengths of sides of each rectangle are not determined, the positiondesignation is effected by specifying the two diagonal points of therectangle.

[Structure Database 4]

Further, for each of the three-dimensional image data stored in thethree-dimensional image database 3, the information of the objectcorresponding to the three-dimensional object ID included in thethree-dimensional image data is stored in the structure database 4. Inthe structure database 4, each of the three-dimensional object IDsincluded in the three-dimensional image data, the physical position(which is indicated as the position from the reference point in thethree-dimensional image data or the latitude and the longitude on theactual ground surface) of the object, the structure ID for uniquelyidentifying the object (structures) and the owner or the manager name ofthe object are stored as one unit record.

In this case, the structure IDs, the physical positions and the owner orthe manager names are previously stored in the structure database 4.Incidentally, in this embodiment, the structure IDs are previouslyopened to the public (but some structure IDs are opened to only theowners or the managers of the objective structures), and are actuallyindicated by numbers which are assigned when structures are constructedor a map is produced. Concerning the three-dimensional object ID in thestructure database 4, when the three-dimensional image data is stored inthe three-dimensional image database 3, the physical position of anobject in the three-dimensional image data is compared with the physicalpositions previously stored in the structure database 4, and thethree-dimensional object ID of the three-dimensional image data isstored in the column of the three-dimensional object ID of the record,the physical positions of which are coincident.

The structure database 4 can be constructed so that onethree-dimensional image data may be dealt with by one database or allthe three-dimensional image data may be dealt with altogether by onedatabase. The structure database 4 can be configured as a relationaldatabase or a normal file type database in the same manner as thethree-dimensional image database 3 and the object database 10.

All the three-dimensional image database 3, the structure database 4 andthe object database 10 are produced or updated after the plural aerialphotographs 1 are processed by the three-dimensional image converter 2to produce their three-dimensional image data.

[Structure ID Finder 5]

The structure ID finder 5 carries out the storing of thethree-dimensional object IDs to the structure database 4. When newthree-dimensional image data is produced by the three-dimensional imageconverter 2 and the produced three-dimensional image data is stored inthe three-dimensional image database 3, the structure ID finder 5 looksup the records in the structure database 4 one by one, for example, likea round robin, and updates the three-dimensional object IDs in thecorresponding physical positions of the records in the structuredatabase 4. This update operation is performed by storing thethree-dimensional object IDs contained in the newly producedthree-dimensional image data for all the records storing the physicalpositions contained in the areas of the newly produced three-dimensionalimage data in the structure database 4. At this time, an object database10 is newly produced on the basis of the newly input plural aerialphotographs.

Hence, the operation of the structure ID finder 5 makes the newlyproduced three-dimensional image database 3 and the newly producedobject database 10 correspond to the structure database 4. In thisoperation, the structure IDs corresponding to all the three-dimensionalobject IDs included in the produced three-dimensional image data are allstored in the structure database 4. This prevents the contradiction thatthere is no structure ID corresponding to the three-dimensional objectID included in the produced three-dimensional image data. Incidentally,the three-dimensional object ID corresponding to the structure ID storedin the objective record cannot be present in the newly producedthree-dimensional image data. In this case, the contradiction can beovercome as follows. For example, a three-dimensional object IDcorresponding to an image showing a flat is made to correspond to thecolumn of the three-dimensional object ID of the record storing thisstructure ID. Alternatively, nothing is made to correspond and the basicimage (the original image before the three-dimensional objects arearranged) is used as it is. When the three-dimensional object IDcorresponding to the image showing the flat is made correspond, thecorrespondence between the image showing the flat and thethree-dimensional object ID can be realized in a new database (notshown). However, the aforementioned construction does not directlyparticipate in the essence of the present invention. Thus, the presentinvention is not restricted to this and various modifications can bemade without departing from the spirit and scope of the presentinvention.

[Operation flow of Structure ID Finder 5]

An operation flow of the structure ID finder 5 will be described inconnection with FIG. 6. In FIG. 6, an operation is initiated by addingnew three-dimensional image data (a set of three-dimensional object IDs)produced by the three-dimensional image converter 2 to thethree-dimensional image database 3.

The structure ID finder 5 then determines variables of thethree-dimensional object IDs included in the three-dimensional imagedata and the physical positions of the objects corresponding to thethree-dimensional object IDs (array variable X[I].three-dimensionalobject ID and array variable X[I].physical position, wherein I is anumber (from 1) of three-dimensional object IDs included in thethree-dimensional image data) by calculations in order to carry out thefollowing processing of all the three-dimensional object IDs included inthe three-dimensional image data. The array variableX[I].three-dimensional object ID is an array of all thethree-dimensional object IDs included in the three-dimensional imagedata, and the array variable X[I].physical number is an array of thephysical positions of the objects corresponding to all thethree-dimensional object IDs included in the three-dimensional imagedata. Incidentally, when [I] is the same, the array variables are forthe same object.

After the determination of the array variables, as described above, thestructure ID finder 5 reads records one by one out of the structuredatabase 4 in arbitrary order. In this case, the records are read out ofthe structure database 4 in a round robin fashion so as to avoidduplication of the readout records in the following processing.

When one record (the first record in the case of the readout in theround robin fashion) is read out in this manner, the structure ID finder5 defines the physical position included in the readout record as avariable Y (variable Y=record->physical position storage items), andthen specifies variable X[I].physical position to obtain the variable Yequal (showing the same physical position) to the array variableX[I].physical position determined as described above. The structure IDfinder 5 then updates the three-dimensional object ID storage items inthe readout record by variable X[I].three-dimensional object IDcorresponding to the specified variable X[I].physical position (I=thesame value). Thereby, the three-dimensional object data corresponding tothe structure ID in the structure database 4 becomes the newly producedshape information and texture information. However, when the variableX[I].physical position for obtaining the array variable X[I].physicalposition equal to the variable Y does not exist, the three-dimensionalobject ID corresponding to the flat image in the unknown database isstored in the column for storing the three-dimensional object ID in thereadout record or, for example, the three-dimensional object ID storingcolumn is left blank to use the original image in reproducing thethree-dimensional solid map.

This processing is repeated until it is executed for all the records forstoring the physical positions included in the newly producedthree-dimensional image data in the structure database 4. In thisembodiment, the three-dimensional object data produced from the pluralaerial photographs cannot be used concerning the object, thethree-dimensional object data of which is changed by the user in theprocessing for producing the three-dimensional solid map, and theupdating of the three-dimensional object ID corresponding to thethree-dimensional object data changed by the user in this processingstep can be prevented. However, in this embodiment, there is no need forpositively preventing the update and this description can be omitted.

[Position Input Type 3-D Image Output Unit 6]

When the position of a three-dimensional image is designated from theoutside, for example, from a user terminal connected via the Internet,the position input type three-dimensional image output unit 6 searchesthe positions of the three-dimensional image data in thethree-dimensional image database 3, and compares the position with thepositions of the three-dimensional image data to specify the record ofthe three-dimensional image data including the designated specificposition. The position input type three-dimensional image output unit 6then reads out the three-dimensional image data part in the specifiedrecord to output the readout image data to the three-dimensional browser8.

[Structure Changer 7]

In this embodiment, the structure changer 7 is constructed in order toreflect data of a structure uploaded using a file transfer protocol(FTP) etc. from the outside, for instance, a particular user (an owneror a manager of the structure) via the Internet to a three-dimensionalsolid map provided for ordinary users. When receiving the change contentabout the object from the particular user, the structure changer 7stores the received content or the three-dimensional object data newlyproduced from the received content correspondingly to the receivedstructure ID in a change object database 11 shown in FIG. 10. The changeobject database 11 can be also constructed so as to be stored in therecording medium 203 shown in FIG. 19 or in another recording medium(not shown). When the data about the object is changed by the particularuser such as the owner or the manager of the structure, since thethree-dimensional object data such as the shape information and thetexture information looked up from the three-dimensional image database3 via the structure database 4 becomes the change object database 11 inFIG. 10, an item showing whether or not a change is made is added to theattribute of the structure database 4. Hence, when the three-dimensionalsolid map is produced, the change yes no item is checked in thestructure database 4. When no change is made, the object database 10shown in FIG. 9 is looked up, and on the other hand, when the change ismake, the change object database 11 is looked up.

The contents of notice given from the outside include the structure ID,the owner name, the shape information of the structure and the textureinformation of the structure. As to the shape information and thetexture information of the structure, the picture of the structure (thepicture showing at least the lacking part of the structure on thethree-dimensional solid map or the pictures showing the whole of thestructure without a dead angle can be used) or the three-dimensionalimage data of the structure can be used.

However, in this case, when the content sent from the owner or themanager is a picture showing only the lacking part, in order to producethe three-dimensional object data from the received picture, thestructure changer 7 obtains the physical position of the structure to bechanged from the structure database 4 by using the received structureID, determines the image ID of the three-dimensional image dataincluding the structure to be changed from the three-dimensional imagedatabase 3 by using the obtained physical position, specifies the pluralaerial photographs in the image ID database 14 by using the obtainedimage ID, determines an image area including the photographed structureto be changed from the obtained physical position for the specifiedplural photographs (a specifying method of this image area: for example,it can be calculated by previously determining an image areasufficiently covering a structure around the physical position), andcalculates three-dimensional object data after the change by using theobtained image area and the picture sent from the owner or the manager.

This three-dimensional image data or a reduced scale of the picture isnot necessarily adapted to the aerial photographs on the user side, andcan be automatically or manually adapted by the structure changer 7 or asimilar device instead thereof on the service provider side. Further,this can be specified from the upload side such as the owner or managerside. In addition, in this embodiment, the structure IDs are previouslyopened to the public (but some structure IDs are opened to only theowners or the managers of the objective structures), and may beindicated by numbers, which are assigned when the structures areconstructed or the map is produced. In this embodiment, the particularusers capable of uploading the change contents are limited to the ownerand the manager of the particular structure to be changed and thepersons entrusted with the right of uploading the change contents fromthe owner or the manager. The construction for this will be hereinafterdescribed in detail.

The structure changer 7 discriminates whether or not the informedstructure ID and the structure. ID coincident with the owner name arepresent, or the owner name is present in the structure ID of thestructure database 4 and in the owner name column. When the coincidentstructure ID and the owner name are not present in the discrimination,the structure changer 7 cancels the received shape information and thetexture information, and does not perform the update of thethree-dimensional object data. On the other hand, when the coincidentstructure ID and the owner name are present, the structure changer 7stores the three-dimensional object data produced on the basis of thediscrimination result or the received change content correspondingly tothe received structure ID in the change object database 11, and alsostores the data indicating the change yes in the change yes no column inthe record including this structure ID in the structure database 4.Concerning the data indicating the change yes or no, for example, it canbe realized by one bit data such as “0” indicating the change no (nochange is made) and “1” indicating the change yes (the change is made).Hence, the three-dimensional object data read out when the changedobject is produced becomes the three-dimensional object data to be readout of the change object database 11 using the structure ID as a mainkey. In this configuration, the owner name, in addition to the structureID, is requested as part of specifying the upload side, and thus thiscan be changed at need.

The reason why the three-dimensional object data such as the shapeinformation and the texture information of the changed object is storedin the separated change object database 11 is as follows. That is, forexample, in the case that the three-dimensional solid map is updated onthe basis of the aerial photographs taken every one week, since the newobject database 10 is produced every one week, the object database 10related to the structure database 4 is updated each time using thethree-dimensional object ID as the main key and as a result, the shapeinformation and the texture information (also hereinafter referred to as“three-dimensional object data after change”) produced on the basis ofthe change content received from the particular user is invalidated in acycle of one week. Therefore, in this embodiment, in order to solve thisproblem, the structure database 4 is newly provided with the change yesno item. Accordingly, when the position input type three-dimensionalimage output unit 6 or the three-dimensional browser 8 reproduces thethree-dimensional solid map, as shown in FIG. 5, the structure database4 is looked up on the basis of the three-dimensional object ID includedin the three-dimensional image data, and the database such as the objectdatabase 10 or the change object database 11 to be looked up is selectedfor reproducing the three-dimensional object on the basis of the changeyes or no stored in the change yes no item in the same record.

[Operation Flow of Structure Changer 7]

An operation of the structure changer 7 will be described with referenceto FIG. 7. FIG. 7 shows only the operation of the structure changer 7.

In FIG. 7, the structure changer 7 is initiated by receiving a structureID, an owner name (the data stored in the owner name item of thestructure database 4) and change content from the outside, for example,a particular user via the Internet.

After the initiation, the structure changer 7 substitutes the receivedstructure ID into a variable X, and the received owner name into avariable Y.

The structure changer 7 then finds the record including the structure IDand the owner name coincident with the substituted variables X and Y,respectively, in the structure database 4. In this process, when thecoincident record is specified, the structure changer 7 produces thethree-dimensional object data on the basis of the received changecontent, and substitutes the produced three-dimensional object data intoa variable Z. Thereafter, the structure changer 7 adds one more recordto the change object database 11, stores the variable X in the item forstoring the structure ID of this record and stores the variable Z in theitem for storing the three-dimensional object data.

With the operation in this manner, the three-dimensional object data isproduced according to the received change content, and is then stored inthe change object database 11. However, at this time, thethree-dimensional object ID included in the three-dimensional image datais still the previous three-dimensional object ID, and when thethree-dimensional solid map is produced, the object is reproduced in theold state before the change. Hence, in this embodiment, in addition tothe above-described operation, the structure changer 7 stores the datashowing the change yes in the change yes no column of the structuredatabase 4. With this step, the received change content can be reflectedon the three-dimensional solid map.

[Three-Dimensional Browser 8]

In this embodiment, a system for improving a three-dimensional airexcursion for providing a three-dimensional solid map for users via theInternet further comprising a three-dimensional browser 8 besides theaforementioned basic members such as the three-dimensional imagedatabase 3, the structure database 4, the object database 10 and thechange object database 11. When first receiving the particular positioninformation from the user via the Internet, the three-dimensionalbrowser 8 sends the received particular position information to theposition input type three-dimensional image output unit 6, and inresponse thereto, receives the three-dimensional image data to store it.For storing this data, the storage device 202 shown in FIG. 19 is used.However, in this embodiment, the present invention is not restricted tothis device and various modifications can be made. Then, when receivingthe particular viewpoint position information from the user, thethree-dimensional browser 8 produces a two-dimensional image of thethree-dimensional solid expression seen from the viewpoint positionaccording to the information on the basis of the storedthree-dimensional image data, and sends the produced two-dimensionalimage to the user. Further, when receiving another viewpoint positioninformation from the user, the three-dimensional browser 8 reproducesanother two-dimensional image of the three-dimensional solid expressionseen from the new viewpoint position of the information, and furthersends the newly produced two-dimensional image to the user. Thisoperation is repeated. As a result, the user can move (move hisviewpoint) in three-dimensions on the three-dimensional solid map viathe three-dimensional browser 8.

Further, when a particular user such as the owner or the manager of aparticular structure requests a change of his own structure, thethree-dimensional browser 8 transfers its content to the structurechanger 7. However, in the aforementioned operation, since thethree-dimensional image data input to the three-dimensional browser 8when the three-dimensional solid map is reproduced is the set of thethree-dimensional object IDs, a ground surface image (a basic image) forarranging the three-dimensional object data is required in order toreproduce the three-dimensional solid map, in addition to thethree-dimensional object data corresponding to the three-dimensionalobject IDs. This ground surface image can be read out of an unshowndatabase (a database for storing the ground surface imagescorrespondingly to their positions) to output the readout image by theposition input type three-dimensional image output unit 6, or can beread out of the unshown database to output the readout image by anotherunshown member in response to a request from the three-dimensionalbrowser 8. Furthermore, on the client side shown in FIG. 5, the unshowndatabase is connected to the three-dimensional browser 8, and the groundsurface image can be directly read out of the unshown database by thethree-dimensional browser 8. Hence, the three-dimensional browser 8arranges the three-dimensional object data on the readout ground surfaceimage to reproduce the three-dimensional solid map. That is, in thisembodiment, the three-dimensional browser 8 reproduces thethree-dimensional solid map on the basis of the three-dimensional imagedata input from the position input type three-dimensional image outputunit 6 constructed on the server side, and includes a positioninformation output means for outputting the position information and theviewpoint position information received from the user to the server sideand a change content notice means for sending the change content of thestructure, received from the user to the server side.

[Operation Flow of Three-Dimensional Browser 8]

An operation of the three-dimensional browser 8 will be described indetail in connection with FIG. 8. In FIG. 8, the three-dimensionalbrowser 8 initiates the operation when receiving the particularphotographing position data for an air excursion from a user accessingthe three-dimensional browser 8 via the Internet. The position dataincludes a viewpoint position and a sight line direction.

After starting the operation, the three-dimensional browser 8 sends thereceived position information to the position input typethree-dimensional image output unit 6 and as a result, receives thethree-dimensional image data at this position from the position inputtype three-dimensional image output unit 6. The three-dimensionalbrowser 8 then produces the two-dimensional image data of thethree-dimensional solid expression in the sight line direction on thebasis of the received three-dimensional image data by using a renderingmethod or the like, and sends the produced two-dimensional image data tothe user. At this time, the three-dimensional browser 8 also obtains theground surface image corresponding to this position.

Thereafter, the three-dimensional browser 8 awaits an input of a nextinstruction from the user. When receiving the instruction of theparticular viewpoint position from the user, the three-dimensionalbrowser 8 executes the same operation as above, and after that, awaits anext instruction. Besides, when receiving a request of the object changeon the three-dimensional solid map from the user, the three-dimensionalbrowser 8 sends the structure ID of the change object and the owner nameof the structure included in the request to the structure changer 7.This operation is finished by inputting a stop instruction from theuser.

Hence, the user can browse the provided three-dimensional solid map asthe two-dimensional image of the three-dimensional solid expression athis terminal via the Internet, and further the particular user such asthe owner or the manager can change or correct the image of thestructure in the image.

[Relationship Among Databases]

In the following, the relationship among the three-dimensional imagedatabase 3, the structure database 4 and the object database 10 will bedescribed with reference to FIG. 9. In this embodiment, it is assumedthat each of the databases shown in FIG. 9 is configured as a relationaldatabase.

As shown in FIG. 9, the three-dimensional image database 3 includes theimage (the image ID), the position (the latitude and the longitude) andthe three-dimensional image data (a set of three-dimensional object IDs)as its attributes. The structure database 4 includes the structure ID,the physical position (the latitude and the longitude), the owner name(or the manager name), the three-dimensional object ID and the changeyes no as its attributes.

In the system shown in FIG. 1, when the three-dimensional image data isproduced from the plural aerial photographs, the producedthree-dimensional image data is stored in the three-dimensional imagedatabase 3 along with the image ID and the position information of thereference point of the three-dimensional image data. For indicating theposition, when the three-dimensional image data to be produced is fixedto, for example, 11 km×11 km square, one point within this square, forexample, the latitude and the longitude of its left lower corner aredesignated. When the range of the three-dimensional image data to beproduced and its shape are not fixed, the latitude and the longitude ofeach vertex of the area included by the three-dimensional image data isdesignated.

When such information is stored in the three-dimensional image database3, by the operation shown in FIG. 6, in order to make thethree-dimensional object IDs included in the newly storedthree-dimensional image data correspond to the three-dimensional objectIDs stored in the structure database 4, the structure ID finder 5specifies the structure IDs of the structures included in thethree-dimensional image data on the basis of the physical positionsstored in the structure database 4, and updates the three-dimensionalobject IDs in the records corresponding to the specified structure IDs.

The items about the attributes such as the structure ID, the physicalposition and the owner name (or the manager name) are previously inputon the service manager side. This is because, like in a usual mapproducing, since each structure such as a building or the like has anidentification number, and further the owner (or the manager) and thephysical position (exact latitude and longitude) are obviousinformation, it is useful to use this information for producing thethree-dimensional solid map as regards intending links with the actualworld in controlling.

Hence, the three-dimensional image database 3 and the structure database4 are related with each other by using the three-dimensional object IDsas the main key.

Further when the three-dimensional image data is produced, thethree-dimensional object data of the structure corresponding to eachthree-dimensional object ID is also produced, and is held as a newdatabase (the object database 10). This object database 10, as shown inFIG. 9, includes the three-dimensional object ID, the shape informationand the texture information as its attributes.

The three-dimensional IDs are the same as those of the other databases.The shape information and the texture information are the informationfor reproducing the target object, and in this embodiment, thisinformation is taken as an example. However, the information forreproducing the object is not limited to the shape information and thetexture information, and other information can be used without departingfrom the spirit and scope of the present invention.

Hence, the structure database 4 and the object database 10 are relatedwith each other by using the three-dimensional object IDs as the mainkey. Concerning the relationship between the three-dimensional imagedatabase 3 and the object database 10, the three-dimensional object IDsmay be used as the main key.

In the following, the relationship among the three-dimensional imagedatabase 3, the structure database 4 and the change object database 11will be described in detail with reference to FIG. 10. In thisembodiment, it is assumed that each of the databases shown in FIG. 10 isconfigured as a relational database.

As shown in FIG. 10, the change object database 11 includes thestructure ID, the shape information and the texture information as itsattributes. The shape information and the texture information areproduced, as described above, on the basis of the change contentreceived from the user or the three-dimensional object data produced onthe basis of the change content.

The structure IDs are the main key also for the relationship between thestructure database 4 and the change object database 11. When thestructure is reproduced by using the change object database 11, thestructure ID is specified by the three-dimensional object ID included inthe three-dimensional image data, and the change object database 11 islooked up by using the specified structure ID to reproduce thestructure. Further, the determination of whether or not this processingis executed is made by looking up the item indicating change yes no onthe same record in the structure database 4.

[Update of Three-Dimensional Object Data]

In this embodiment, an update of three-dimensional object data of anobject by a particular user such as an owner or a manager of aparticular structure to be updated and a person given an update rightfrom the owner or the manager via the Internet will be described indetail.

[User Authentication]

When the three-dimensional object data on the three-dimensional solidmap is updated, first, an updater must be limited from the viewpoint onthe service provider side. If the update right is given to all users,the three-dimensional object data can be falsely changed by the imagedata different from the actual structure or the image data to give theowner disadvantages.

FIG. 11 shows a configuration of a system for authenticating un updaterwhen the updater accesses the system for changing the image of astructure via the Internet.

As shown in FIG. 11, for the user authentication, a three-dimensionalbrowser 8, an authentication processor 9, a structure database 4, anauthentication database 12 and a change object database 11 are providedon the service provider side (the service manager side). Theauthentication database 12 can be provided in the recording medium 203shown in FIG. 19 or an unshown recording medium. On a changing side(change content sending side), a user terminal 20 is connected to thethree-dimensional browser 8 via the Internet 100. In FIG. 11, astructure changer 7, a standard database 13 and the change objectdatabase 11 will be hereinafter described in detail in connection with achange content input flow shown in FIG. 15. In the following operation,the three-dimensional browser 8 only converts and transfers the contentscommunicated between the authentication processor 9 and the userterminal 20 depending on its purposes, and therefore, thisintermediation function can be omitted for brevity in the description.

In addition, the authentication processor 9 of FIG. 11 can be realizedby the system shown in FIG. 19. That is, a program for executing andoperating the authentication processor 9 is stored in the recordingmedium 203 shown in FIG. 19 or in the unshown recording medium, and whenthe authentication processor 9 is operated, this program is read out bythe data processing device 201. Thus, the work area is ensured in thestorage device 202 and the program is executed or operated.

In this embodiment, the structure database 4 has the same constructionas that shown in FIG. 9. The authentication database 12 has the datastructure shown in FIG. 12. Incidentally, this authentication database12, like the aforementioned databases, can be configured as a relationaldatabase or a normal file type database. In this description, theauthentication database 12 is explained as the relational database. Theauthentication database 12 is related with the structure database 4 bythe structure IDs as the main key. The configuration of databases havingthis relationship will be described with reference to FIG. 12.

As shown in FIG. 12, the authentication database 12 includes thestructure ID, a password, an address and an e-mail (electronic mail)address as its attributes. The structure ID is the same as that of thestructure database 4. Hence, the structure database 4 and theauthentication database 12 are related with each other by the structureIDs as the main key. In addition, as described above in connection withFIG. 10, the relationship between the structure database 4 and thechange object database 11 is established by the structure IDs as themain key. Hence, the change yes is indicated in the change yes no columnof the structure database 4 on the basis of the structure ID sent fromthe updating side, and further one record composed of a set of thestructure ID and the changed three-dimensional object data can be addedto the change object database 11.

Additionally, the address is the address of the structure to be changedand the e-mail address is the contact address of the owner (includingthe manager and the person given the update right from the owner or themanager) on the updating side.

The password is given from the service provider side when the ownerregisters at the service provider side in advance that the owner dulypossesses the right for updating the three-dimensional object data. Asthe above-described register procedure of the owner to the serviceprovider side, there is a method in which the user sends the necessaryitems to be stored in the authentication database 12 to the serviceprovider side via the Internet, and after the validity of the user isverified on the service provider side, the necessary items are stored inthe authentication database 12. The register method is not restricted tothis and various modifications can be made without departing from thespirit and scope of the present invention.

On the changing side, the particular user accesses the authenticationprocessor 9 from the user terminal 20 via the Internet 100, and sendshis password, his name (owner name) and the structure ID assigned to thestructure as the change target. On the service provider side, theauthentication processor 9 discriminates whether or not the user has thevalid update right. In this discrimination, the authentication processor9 looks up the passwords stored in the authentication database 12 tocompare with the received password based on the received structure ID,and also looks up structure database 4 to compare with the receivedowner name based on the received structure ID.

In the case where the user is verified as the rightful person in theauthentication processing, the structure changer 7 is made to execute achange content input flow to produce the three-dimensional object dataon the basis of the received change content besides the password, theowner name and the structure ID. The structure changer 7 stores theshape information and the texture information of the producedthree-dimensional object data corresponding to the structure ID in thechange object database 11. Further, the structure changer 7 stores thedata of “change yes” in the change yes no column of the correspondingrecord of the structure database 4.

The authentication processor 9 can be provided as a server on theservice provider side or can be also provided as a client connected tothe server. The structure changer 7 can be provided as well. When thesystem is constructed as client-server architecture, the client and theserver are connected via a network such as a LAN (local area network) orthe Internet.

Concerning a change content sending method from the user, a pictureshowing only the lacking part of the structure, or the three-dimensionalobject data of the structure produced by the user is uploaded.Alternatively, a certain extent of function is provided from the serviceprovider side to the user terminal 20 via the Internet 100 to upload.These methods will be hereinafter described in detail in connection withthe operation of the embodiment.

[Operation of First Embodiment]

An operation of a system for realizing a three-dimensional excursion foran ordinary user and a structure image correction service for aparticular user on a three-dimensional solid map according to thepresent invention will be described in detail with reference to theattached figures.

[User Authentication Flow]

First, in this embodiment, the users capable of updating a structure arelimited and the valid updaters are registered on the service providerside in advance. An operation of a user authentication processing willbe described in detail in connection with FIG. 13. While a userauthentication processing and a structure change content inputprocessing are performed in the separated flows in this embodiment, thepresent invention is not restricted to this and the two processes can becarried out in the same flow.

In FIG. 13, a particular user such as an owner, a manager or a persongiven right for updating a particular structure from the owner or themanager accesses the authentication processor 9 shown in FIG. 11 fromthe user terminal 20 to initiate the operation in step S201.

The authentication processor 9 then requests the user terminal 20 tosend the owner name and the structure ID of the target structure, andthe previously given password in step S101. This request can be realizedby setting up a home page for inputting the necessary items on the WWWbrowser of the user terminal 20.

In response to the request of the authentication processor 9, the userinputs the owner name of the structure to be updated, the structure IDand the assigned password to send them to the authentication processor 9in step S202.

When receiving the owner name, the structure ID and the password fromthe user terminal 20, the authentication processor 9 looks up thestructure database 4 by using the received structure ID to read out theowner name stored in the same record, and further looks up theauthentication database 12 to read out the password stored in the samerecord in step S102.

Thereafter, the authentication processor 9 discriminates whether or notthe readout owner name and password are coincident with the owner nameand password sent from the user in step S202 in step S103. In thisdiscrimination, when both the owner names and passwords are coincident(step S103 YES), the authentication processor 9 sends the verifiedresult of the user authentication (authentication permitted) to the userterminal 20 in step S104, and sends the received structure ID to thestructure changer 7 shown in FIG. 11 via the LAN or the Internet 100 topermit the structure changer 7 to boot an operation for receiving thechange content of the structure (change content input flow) sent fromthe user terminal 20. The authentication processor 9 then finishes aseries of operation.

On the other hand, in the discrimination in step S103, at least eitherof the owner names or the passwords are not coincident (step S103 NO),the authentication processor 9 sends the unverified result of the userauthentication (authentication unpermitted) to the user terminal 20 instep S106, and then finishes a series of operation.

The user terminal 20 discriminates which is received from theauthentication processor 9, the user authentication permitted orunpermitted in step S203. When receiving the authentication unpermitted(step S203 UNPERMITTED), the user terminal 20 shows the unverifiedresult of the user authentication on the screen in step S204, andfinishes a series of operation. On the other hand, when receiving theauthentication permitted (step S203 PERMITTED), the operation proceedsto step S205 for dealing with the change content input flow.

[Change Content Input Flow]

After the verified result of the user authentication, in thisembodiment, a process flow for inputting the objective structure changecontent sent from the user and newly storing the shape information andthe texture information in the change object database 11 is carried out.This flow will be described in detail in connection with the attachedfigures. Components that execute each process in this flow areillustrated in FIG. 11. In the present invention, the aforementioneduser authentication process can be omitted, and the change content inputflow can be directly provided for users. This is useful in the case thatthere is no limitation on users who provide the change content, and allordinary users can update the three-dimensional solid map. However, insuch configuration, it is desirable that the user first accesses thestructure changer 7 via the three-dimensional browser 8 shown in FIG.11.

As shown in FIG. 11, in this embodiment, the user terminal 20 of theuser on the changing side is connected to the structure changer 7 on theservice provider side via the three-dimensional browser 8. In thefollowing operation, the three-dimensional browser 8 only converts andtransfers the contents communicated between the user terminal 20 and thestructure changer 7 depending on its purposes, and in this embodiment,the intermediation function is omitted for brevity in the description.

In FIG. 11, the structure changer 7 is connected to the structuredatabase 4, the change object database 11 and the standard database 13.The standard database 13 can be stored in the recording medium 203 shownin FIG. 19 or in the unshown recording medium. The structure changer 7specifies the record including the shape information and the textureinformation for updating the structure in the change object database 11on the basis of the structure ID sent from the authentication processor9. The structure changer 7 is connected to the authentication processor9 via the LAN (not shown) or the Internet 100 to receive the structureID sent from the authentication processor 9.

In FIG. 11, the standard database 13 connected to the structure changer7 stores the standard for preventing the change content sent from theuser terminal 20 from being larger or smaller than the permitted area tostore the structure on the three-dimensional solid map. The dataconfiguration of the standard database 13 is shown in FIG. 14.

[Standard Database 13]

As shown in FIG. 14, the standard database 13 includes the structure IDand the ground area standard as its attributes. The structure ID is thesame as that of the structure database 4, and the standard database 13is related with the structure database 4 by the structure IDs as themain key. The ground area standard indicates the ground area occupied bythe structure on the three-dimensional solid map or in the actual world,and is used as the standard when the three-dimensional object data isupdated. In this embodiment, when the change content does not extend outof the ground area or become smaller compared to the reduced scale ofthe three-dimensional solid map, the change content is basically treatedas meeting the standard. This standard can be determined more strictly.Further, as to the ground area standard, not only the ground surface isjudged but also the area in the vertical direction perpendicular to theground surface can be used for determining the standard. These processeswill be described later in detail.

The change content input process flow using the above-described systemwill be described in detail with reference to FIG. 15.

In FIG. 15, receiving an instruction for executing the change contentinput flow from the authentication processor 9, the structure changer 7on the service provider side first looks up the structure database 4 onthe basis of the structure ID sent from the authentication processor 9to specify the three-dimensional object ID stored in the same record,and further, looks up the object database 10 on the basis of thespecified three-dimensional object ID to specify the correspondingthree-dimensional object data in step S107.

The structure changer 7 also looks up the standard database 13 using thestructure ID to specify the ground area standard of the target structurein step S108. The specified ground area standard is used in the latterpart processing.

Thereafter, the structure changer 7 makes the user terminal 20 set up anexclusive home page for inputting the change content by the WWW browserin step S109. At this stage, the access target of the user terminal 20is moved from the authentication processor 9 to the structure changer 7.This access target change is automatically processed by theauthentication processor 9. That is, for the user, the WWW browser isjumped from the home page for inputting the user authentication to thehome page for inputting the change content.

When the home page for inputting the change content is set up on theuser terminal 20 in step S205, on the changing side, the predetermineditems of the change content are input to the setup change content homepage, and the input change content is sent to the structure changer 7 instep S206. In this embodiment, the predetermined items of the changecontent will be described later in detail.

Accordingly, when receiving the change content sent in step S206, thestructure changer 7 produces the changed three-dimensional object dataon the basis of the received change content in step S110. The producingmethod of the three-dimensional object data after the change will bedescribed later for every received change content.

After the three-dimensional object data after the change is produced instep S110, the structure changer 7 discriminates whether or not thechanged three-dimensional object data meets the ground area standard ofthe target structure in step S111. The ground area standard to be usedat this time has been specified in step S108.

In step S111, when the received change content does not meet the groundarea standard of the target structure (step S111 NO), the structurechanger 7 specifies a part in the change content, which is against theground area standard in step S114, and sends the information of thespecified part to the user terminal 20 in step S115. The user terminal20 discriminates whether or not to receive the notice informing thecontent against the ground area standard in step S207. When receivingthe against notice (step S207 YES), the user terminal 20 displays theagainst content included in the received against notice on a display instep S210, and the flow returns to step S205 for the user to input thechange content again. At this time, the structure changer 7 returns tostep S110 and allows the user terminal 20 to set up again the home pagefor inputting the change content.

Then, in step S111, when the received change content meets the groundarea standard of the target structure (step S111 YES), the structurechanger 7 stores the changed three-dimensional object data (the shapeinformation and the texture information) produced on the basis of thereceived change content correspondingly to the received structure ID inthe change object database 11, and also stores the data indicating the“change yes” in the change yes no column of the record corresponding tothe structure to be updated in the structure database 4 in step S112.Thereafter, the structure changer 7 informs the user terminal 20 of thenormal finish of the update in step S113, and finishes a series ofoperation.

The user terminal 20 suspends the operation until the update is normallycompleted and this result is sent to the user terminal 20 in step S208,and after receiving the completion of the update (step S208 YES), theuser terminal 20 displays the finish of the update to give the user thisnews in step S209, thereby finishing a series of flow.

[Standard Meeting Discrimination Flow]

The standard meeting discrimination flow for discriminating whether ornot the change content received in step S111 meets the ground areastandard will be described in connection with FIG. 17.

FIG. 17 shows the standard meeting discrimination process flow. In FIG.17, after the three-dimensional object data after the change is producedin step S110 shown in FIG. 15, first, the structure changer 7 comparesthe ground surface (bottom) area of the changed three-dimensional objectdata with the ground area standard specified in step S108 in FIG. 15 instep S111-01.

As a result of the comparison in step S111-01, when the ground surfacearea of the produced object extends out of the ground area standard(step S111-02 NO), the operation of the structure changer 7 follows stepS111 NO in FIG. 15. On the other hand, when the ground surface area ofthe produced object meets the ground area standard (step S111-02 YES),the structure changer 7 determines the position of the produced object,for example, with respect to the ground surface in step S111-03, andthen compares the three-dimensional area of the solid form of the objectin the determined position with the area in the vertical directionperpendicular to the ground surface of the ground area as the standardin step S111-04.

In the comparison in step S111-04, when the three-dimensional area ofthe object stretches out of the solid area having the bottom of theground area standard (step 111-05 NO), the operation of the structurechanger 7 follows step S111 NO. On the other hand, in the comparison instep S111-04, when the three-dimensional area of the object does notextend out of the solid area having the bottom of the ground areastandard (step 111-05 YES), the operation of the structure changer 7follows step S111 YES. In step S111 shown in FIG. 15, the processing iscarried out as described above.

[Change Content Required of User]

The data for the change content required of user (changing side) will bedescribed with reference to its preferred examples. This requirement isnot restricted by the following description and various modificationscan be made without departing from the spirit and scope of the presentinvention.

The data for the change content can be required, as described above, byseveral methods. For instance, there are a method for requiring theimage of only the lacking side of the object, a method for requiring aplurality of images photographed to include all the sides regardless ofthe lacking side, and a method for requiring the three-dimensionalobject data produced by the user himself.

[Requiring Only Lacking Side]

A case that the user uploads the image of the lacking side of the objectwill be described. The user first takes a picture of the object by usinga digital camera or an analog camera, and then produces image data fromthe digital image or the analog image by using a scanner or the like.Then, the user uploads the obtained image data to the structure changer7 by using a proper protocol such as the FTP. In this embodiment, a homepage (the change content input home page) to be used can be readilyprepared from a usual home page, and thus the detailed descriptionthereof can be omitted.

Besides, the method for producing the three-dimensional object data ofthe structure to be changed on the basis of the uploaded image data canbe readily realized by the above-described stereographic processing. Inthis case, regarding the dimensions of the objective building, thevalues obtained by producing the three-dimensional object data from theplural aerial photographs can be effectively used, and hence thematching or adjustment of the reduced scale and the like becomes out ofthe problem. Furthermore, when there are the plural number of lackingsides, the plural number of image data of all the lacking sides or oneimage data covering all the lacking sides can be uploaded to produce theperfect three-dimensional object data. When the stereographic processingis performed based on such image data to produce the three-dimensionalobject data after the change, the position (the latitude and thelongitude) of the photographed area and the distance and the angle tothe ground surface are required. This is because these parameters areused for the stereographic processing itself.

In the case of requiring only the lacking side, the image data exceptthe informed side is necessarily specified. For this method, asdescribed above, it is thinkable to perform the following operations.That is, the structure changer 7 determines the physical position of thestructure to be changed in the structure database 4 by using theinformed structure ID, obtains the image ID of the three-dimensionalimage data including the target structure from the three-dimensionalimage database 3 by using the determined physical position, specifiesthe plural aerial photographs in the image ID database 14 shown in FIG.16 by using the obtained image ID, and determines the image areaincluding the photographed structure to be changed from the specifiedplural aerial photographs by using the obtained physical position. Inorder to specify the image area, for example, a sufficient image area toinclude the structure is previously determined around the physicalposition. As a result, the structure changer 7 can obtain thethree-dimensional object data after the change by using the determinedimage area and the received photographs.

Referring to FIG. 16, in this embodiment, the image ID database 14includes the image ID and the aerial photograph ID as its attributes.The image ID is the same as t h a t of the three-dimensional imagedatabase 3. The aerial photograph ID is the ID information assigned toeach aerial photograph to be processed when producing thethree-dimensional image data. There are several methods for assigningthe aerial photograph ID, in which a manager of the server shown in FIG.5 can assign and input, or the three-dimensional image converter 2 ofthe server can operate to automatically assign. Alternatively, theposition information of the three-dimensional image database 3 can beused as the aerial photograph ID. However, the present invention is notlimited to these methods and any information for suitably identifyingeach aerial photograph can be applicable. Hence, the image ID database14 constructed as above and the three-dimensional image database 3 arerelated with each other by the image IDs as the main key.

When updating the three-dimensional object data using the image IDdatabase 14, the structure changer 7 shown in FIG. 11 specifies thephysical position of the object to be updated on the basis of thestructure ID sent from the user via the authentication processor 9, andalso specifies the image ID of the three-dimensional image dataincluding the specified physical position in the three-dimensional imagedatabase 3. Then, the structure changer 7 specifies the aerialphotograph ID corresponding to the specified image ID in the image IDdatabase 14, and also specifies the area including the object to beupdated from the aerial photograph corresponding to the specified aerialphotograph ID. Eventually, the structure changer 7 produces thethree-dimensional object data after the change by using the image dataof the specified area and the image data sent from the user.

[Requiring all Sides]

In the case of requiring at least one number of image data including allthe sides of the structure to be updated from the user, the perfectthree-dimensional object data can be produced by the stereographicprocessing in the same manner as the case requiring only the lackingside. In this case, for each image data, the position (the latitude andthe longitude) of the photographed area and the distance and the angleto the ground surface are required.

[Requiring Three-Dimensional Object Data]

In the case of requiring the three-dimensional object data alreadyproduced in the perfect state from the user, the user uploads thethree-dimensional object data produced by any method to the structurechanger 7 by using the proper protocol such as the FTP in the samemanner as described above. When receiving the three-dimensional objectdata, the structure changer 7 converts the object according to thethree-dimensional object data in consideration of or coincident with thereduced scale of the object, and stores the produced object into thechange object database 11 correspondingly to the newly assignedthree-dimensional object ID.

In the above-described examples, the shape of the object or the targetstructure is changed depending on the uploaded change content andbecomes against the ground area standard assigned to the structure. Inorder to cope with this problem, in this embodiment, the processes shownin FIG. 17 are required.

[Requiring Change of Parameters]

The necessary parameters can be input on the home page (the changecontent input home page) by the user.

Conceivably, the change content input home page may have a configurationshown in FIG. 18.

With reference to FIG. 18, the change content input home page, in whichthe object is produced by mapping the two-dimensional texture (texturemapping) on the object modeled as a solid, will be explained as anexample. In this case, the change content required of the user isrevision or correction of the two-dimensional image to be mapped on theobject. In the present invention, the correction target on the changecontent input home page can include not only the texture but also theobject to be modeled. In this case, the change content input home pageis provided with a function for correcting the newly modeled object.When the function for changing the shape of the object is provided, theadaptability of the correction is judged by the standard meetingdiscrimination flow shown in FIG. 17.

On the change content input home page, the work area is to be set up inthe user terminal 20. After completing the correction, the user canupload the corrected mapping image as the correction content by clickingthe “completion” button formed on the home page. Further, it isdesirable to use the mapping image produced in the type supported by theuser terminal 20. Accordingly, with a function of a plug-in or the like,the user can readily correct the mapping image on the home page.

In this embodiment, the three-dimensional object data is produced on thebasis of the uploaded data (change content), and is then stored in thechange object database 11 correspondingly to the newly assignedthree-dimensional object ID.

As described above, according to the present invention, in a server, aclient for improving a three-dimensional air excursion and a method andprograms thereof, a three-dimensional data can be automatically producedfrom aerial pictures or satellite images taken from an airplane or anartificial satellite, and the three-dimensional air excursion can beenjoyed on a three-dimensional solid map. With the use of the aerialpictures or the satellite images, a manual map production can bereplaced by an automatic work, and the map information can be readilyupdated. For example, by using the artificial satellite IKONOS, theupdate of the whole earth surface can be carried out every week. Hence,the image of the same area, where the field covered with snow last weekis completely changed to the green grass field this week, or the tintedautumnal leaves changing every week in autumn can be timely exhibited.Similarly, the change of the eruption state of a volcano can be readilyreported every day. As to the update of the related information withmap, in the present invention, such up-to-date information can beoffered for searching it when a user needs it.

Moreover, in prior art 1 of Japanese Patent No. 2,756,483 entitled“Advertisement information providing method and its registering method”,since the related information is previously fastened to the map, whenthe newest information is provided, the update is always performedmanually. This is not practical considering the actual use. In thepresent invention, this problem can be overcome and the up-to-dateinformation can be always provided for the users.

With the use of this system, the air excursion service can be providedon the Internet. In the case where the satellite images or the aerialphotographs cannot be taken successfully, and therefore thethree-dimensional image cannot be produced properly, the owner or themanager of this structure may want to correct the three-dimensionalimage. Further, in the case of a park, a usual landform or the like,when there is no owner or manager in particular, a user of the airexcursion via the Internet as a volunteer can want to correct itsthree-dimensional image to make it look better.

Hence, according to the present invention, when the three-dimensionalimage is automatically produced using the aerial photographs, and theair excursion service is carried out on the three-dimensional solid mapvia the Internet, the three-dimensional image database can be improvedby the mutual cooperation of the Internet users all over the world.

While the present invention has been described with reference to theparticular illustrative embodiments, it is not to be restricted by thoseembodiments but only by the appended claims. It is to be appreciatedthat those skilled in the art can change or modify the embodimentswithout departing from the scope and spirit of the present invention.

1. A method for improving a three-dimensional air excursion using aserver for improving a three-dimensional air excursion and a client forimproving a three-dimensional air excursion, comprising the steps of:outputting a change content sent from a user for updating a structureincluded in a three-dimensional solid map to the server by a changecontent output means in the client; and producing three-dimensionalobject data of the structure after the change on the basis of the changecontent of the structure sent from the client by a structure changingmeans in the server.
 2. A method of claim 1, wherein the structuredatabase includes a change yes no column for showing whether or not thethree-dimensional object data after the change is produced by thestructure changing means, wherein the structure changing means stores achange yes in the change yes no column of the structure database whenproducing the three-dimensional object data after the change, furthercomprising the steps of: storing the three-dimensional object data andthe three-dimensional object identification in an object database in theserver; storing the three-dimensional object data after the change andthe structure identification in a change object database in the server;outputting the position information input by the user to the server by aposition information output means in the client; reading thethree-dimensional image data out of the three-dimensional image databaseon the basis of the input position information, looking up the changeyes no column of the structure database by using the three-dimensionalobject identification included in the readout three-dimensional imagedata, extracting the three-dimensional object data after the change fromthe change object database by using the coincident structureidentification when the change yes is included in the change yes nocolumn, extracting the three-dimensional object data from the objectdatabase by using the three-dimensional object identification when thechange no is included in the change yes no column, and outputting theextracted three-dimensional object data included in thethree-dimensional image data by a position input type three-dimensionalimage output means in the server; and producing a three-dimensionalimage solid expression from the viewpoint position information input bythe user on the basis of the three-dimensional image data sent from theposition input type three-dimensional image output means by athree-dimensional browser in the client.
 3. A method of claim 1, furthercomprising the steps of: storing the physical position of the structureon the ground surface in the structure database; and calculating thephysical position of the structure corresponding to thethree-dimensional object identification included in thethree-dimensional image data on the basis of the ground surface positioncorresponding to the three-dimensional image data, specifying thestructure identification of the structure database on the basis of thecalculated physical position and the physical position of the structurein the structure database, and storing the three-dimensional objectidentification corresponding to the structure, corresponding to thespecified structure identification by a structure identification findingmeans in the server.
 4. A method of claim 1, wherein the change contentof the structure includes image data including at least one side to bechanged for an objective structure, a ground surface position of aphotographed area and a camera position, further comprising the stepsof: outputting the structure identification of the structure to beupdated to the server by the change content output means in the client;and specifying the photograph data including the structure on the basisof the structure identification input by the client and newly producingthe three-dimensional object data after the change on the basis of thespecified photograph data and the input image data by the structurechanging means in the server.
 5. A method of claim 1, wherein the changecontent of the structure to be changed includes image data including allsides for an objective structure, a ground surface position of aphotographed area and a camera position, further comprising the step ofnewly producing the three-dimensional object data after the change onthe basis of the input image data by the structure changing means.
 6. Amethod of claim 1, wherein the three-dimensional object data and thethree-dimensional object data after the change include shape informationrepresenting a size and a shape of the structure and texture informationrepresenting a texture mapped to each side of the structure, wherein thechange content of the structure is about the shape information and thetexture information.
 7. A method of claim 1, further comprising thesteps of: storing a ground area standard of the structure on thethree-dimensional solid map, corresponding to the three-dimensionalobject identification in a standard database, discriminating whether ornot the three-dimensional object data produced after the change meetsthe ground area standard; and storing the three-dimensional object dataafter the change in the change object database when thethree-dimensional object data after the change meets the ground areastandard by the structure changing means.
 8. A method of claim 1,further comprising the step of executing the stereographic processing ofthe photograph data and producing the three-dimensional image dataincluding the three-dimensional object identification for uniquelyidentifying the produced three-dimensional object data by athree-dimensional image converting means in the server.
 9. A method ofclaim 1, wherein the photograph data is either an aerial photograph or asatellite image taken from an upper air.
 10. A computer program for aclient for improving a three-dimensional air excursion to executeprocesses of: outputting position information input by a user to aserver preparing a change yes no column for showing whether or not thethree-dimensional object data after the change is produced by the serverin the structure database, storing a change yes in the change yes nocolumn of the structure database when producing the three-dimensionalobject data after the change, storing the three-dimensional object dataand the three-dimensional object identification in the object database,and storing the three-dimensional object data after the change and thestructure identification in a change object database, by a positioninformation output means; and having the server read thethree-dimensional image data out of the three-dimensional image databaseon the basis of the input position information, extract thethree-dimensional object data from the object database by using thethree-dimensional object identification included in the readoutthree-dimensional image data, and output the extracted three-dimensionalobject data included in the three-dimensional image data, and therebyproducing a three-dimensional image solid expression from the viewpointposition information on the basis of the received three-dimensionalimage data by a three-dimensional browser.